Golf aid including heads up display

ABSTRACT

A golf aid for displaying one or more golf-related statistics to a user includes a golf ball tracking system for tracking a flight of a golf ball, a heads up display, and a processor in communication with the golf ball tracking system and the heads up display. The heads up display is configured to be worn on the user&#39;s head and display an image within the user&#39;s field of view. The processor is configured to compute one or more shot statistics from the tracked flight of the golf ball and display the one or more computed shot statistics within the field of view of the user via the heads up display. The one or more shot statistics include at least one of an initial ball speed, a spin rate, a carry, and a remaining distance to the pin.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of and claims the benefit ofpriority from U.S. patent application Ser. No. 13/971,211, filed Aug.20, 2013, which is a continuation of and claims the benefit of priorityfrom U.S. Pat. No. 8,540,583, filed Dec. 30, 2011, which is herebyincorporated by reference in its entirety.

TECHNICAL FIELD

The present invention relates generally to a golf aid for conveyinggolf-related information via a heads up display.

BACKGROUND

The game of golf is an increasingly popular sport at both amateur andprofessional levels. Both amateur and professional golfers spendsizeable amounts of time developing the muscle memory and fine motorskills necessary to improve their game. Golfers try to improve theirgame by analyzing launch and trajectory information while playing golf.

SUMMARY

A golf aid for displaying one or more golf-related statistics to a userincludes a golf ball tracking system for tracking a flight of a golfball, a heads up display, and a processor in communication with the golfball tracking system and the heads up display. The heads up display isconfigured to be worn on the user's head and display an image within theuser's field of view. The processor is configured to compute one or moreshot statistics from the tracked flight of the golf ball and display theone or more computed shot statistics within the field of view of theuser via the heads up display. The one or more shot statistics includeat least one of an initial ball speed, a spin rate, a carry, and aremaining distance to the pin.

In another embodiment, the processor is configured to compute one ormore shot statistics from the tracked flight of the golf ball, maintainone or more play statistics relating to a plurality of golf shots, anddisplay the one or more computed shot statistics, the one or more playstatistics, and an enhanced image of the golf ball flight within thefield of view of the user via the heads up display. The one or more playstatistics may include at least one of a total number of strokes for around, a score relative to par, a number of fairways hit, a number ofgreens in regulation, and an average number of puts per green.

In another embodiment, the processor may be operable to executeinstructions stored on a non-transitory, computer readable medium toassist a user by displaying one or more golf-related statistics. Whenexecuted, the stored instructions cause the processor to perform stepsthat include receiving an indication of a tracked flight of a golf ballfrom a sensor, computing one or more shot statistics from the trackedflight of the golf ball, and displaying the one or more computed shotstatistics via a heads up display.

The above features and advantages and other features and advantages ofthe present invention are readily apparent from the following detaileddescription of the best modes for carrying out the invention when takenin connection with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic partially perspective view of embodiment of thedisclosed system.

FIG. 2 is a schematic diagram of the embodiment of FIG. 1.

FIG. 3 is a top view of a golf ball provided with communicationcomponents.

FIG. 4 is a perspective partial cross sectional view of the golf ball ofFIG. 3.

FIG. 5 is a schematic side perspective view of a golfer wearing thesystem shown in FIGS. 1-2 and hitting the golf ball of FIGS. 3-4.

FIG. 6 is an schematic enhanced image of the golf ball imposed upon thegolfer's real world view.

FIG. 7 is a schematic perspective view of information displayed on theeyeglasses of FIGS. 1-2.

FIG. 8 is a schematic flow chart of a method of displaying an enhancedimage of the golf ball imposed upon the golfer's real world viewaccording to an embodiment.

FIG. 9A is a schematic perspective view of a golfer's real world view ofa golf hole.

FIG. 9B is a schematic enhanced image of distance markers imposed uponthe golfer's real world view of FIG. 9A.

FIG. 9C is a schematic enhanced image of distance markers imposed uponthe golfer's real world view of FIG. 9A.

FIG. 10 is a schematic enhanced image of putting aid imposed upon agolfer's real world view.

FIG. 11 is a schematic enhanced image of shot statistics and playstatistics imposed upon the golfer's real world view of FIG. 9A.

FIG. 12 is a schematic enhanced image of a plurality of ball traces andboth shot statistics and club statistics imposed upon a golfer's realworld view.

FIG. 13 is a schematic enhanced image of an optimized club selection andtarget imposed upon the golfer's real world view of FIG. 9A.

FIG. 14 is a schematic flow chart of a method that may be performed by aprocessor to provide enhanced imagery within a practice mode, before ashot, during a shot, and after a shot.

DETAILED DESCRIPTION

A system for tracking a golf ball is disclosed. The system may track thetrajectory of a golf ball and display an enhanced image of the golf ballon a display such that the enhanced image is imposed upon a user's realworld view. Displaying an enhanced image of the golf ball may help auser view the trajectory of the golf ball and find the golf ball afterthe golf ball lands. In some embodiments, the system may display anenhanced image of the golf ball on a heads-up display configured to beworn on a person's head. For example, the heads-up display may include apair of eyeglasses having a lens. By displaying an enhanced image of thegolf ball on the lens, the user may view the enhanced image whileremaining hands-free. The enhanced image may include at least a portionof the trajectory of the golf ball. Thus, the enhanced image mayfacilitate tracking the trajectory of the golf ball, which may help theuser to compare the golf ball's trajectory with an ideal trajectory. Theenhanced image may also help the user see where the golf ball lands,which may help a user find the golf ball. The system may display otherinformation, such as launch and flight information about the ball, onthe heads-up display.

FIGS. 1 and 2 illustrate an embodiment of a system 100 for tracking agolf ball. System 100 may include a display device configured to be wornon a person's head. As shown in FIG. 1, the display device may include apair of eyeglasses 102. For example, the display device may include anyof the head mounted displays described in U.S. Pat. No. 7,595,933,entitled Head Mounted Display System, issued to Tang on Sep. 29, 2009,the disclosure of which is hereby incorporated by reference in itsentirety. A display system 208 may be associated with eyeglasses 102 todisplay images to the user. System 100 may include a golf ball trackingsystem 200 to track the location of a golf ball. System 100 may includea user tracking system 206 to track the location of the user to helpnavigate and/or determine distances between the user and landmarks, suchas, for example, trees, sandtraps, doglegs, natural hazards (e.g.,water, tall grass, bluffs etc), front/middle/back portions of a green,layup areas, and/or the next pin on the golf course. System 100 mayinclude a camera 204 configured to capture and record images of theuser's real world view to determine where to display enhanced images tothe user such that the enhanced images are imposed upon the user's realworld view. System 100 may include an interface 114 to enable a user tocommunicate with system 100. System 100 may include at least oneprocessor 202 configured to control camera 204, golf ball trackingsystem 200, user tracking system 206, and/or display system 208. In someembodiments, processor 202 may be coupled to camera 204, golf balltracking system 200, user tracking system 206, and/or display system208. In some embodiments, processor 202 may be configured to communicatewith camera 204, golf ball tracking system 200, user tracking system206, and/or display system 208. In some embodiments, system 100 mayinclude more than one processor. For example, in some embodiments, aseparate processor may be included for each component of system 100.

In this manner, the processor 202 may be embodied as one or multipledigital computers, data processing devices, and/or digital signalprocessors (DSPs), which may have one or more microcontrollers orcentral processing units (CPUs), read only memory (ROM), random accessmemory (RAM), electrically-erasable programmable read only memory(EEPROM), high-speed clock, analog-to-digital (A/D) circuitry,digital-to-analog (D/A) circuitry, input/output (I/O) circuitry, and/orsignal conditioning and buffering electronics. The processor 202 mayfurther be associated with computer readable non-transitory memoryhaving stored thereon instructions that cause the processor 202 toprovide an informational display to a user via the display system 208

While the embodiment of FIG. 1 includes eyeglasses 102, otherembodiments may include other types of display devices configured to bemounted on a person's head. For example, system 100 may include a visor,helmet, or goggles. The type of display device may be selected based ona variety of factors. For example, the type of display device may beselected based on the type of environment system 100 is meant to be usedin. Components of system 100 may be mounted to eyeglasses 102.Eyeglasses 102 may be hollow such that components of system 100 may behoused within eyeglasses 102. In some embodiments, eyeglasses 102 mayinclude a removable cover 118 for allowing access to any componentsmounted within eyeglasses 102. Eyeglasses 102 may include one or morelenses. FIG. 1 shows eyeglasses 102 with a single lens 104. In someembodiments, lens 104 may include a partially reflective mirror. Thepartially reflective mirror may allow the real world to be seen throughthe reflected surface such that a transparent image may be imposed upona real world view.

Display system 208 may be mounted on and housed within eyeglasses 102.In some embodiments, display system 208 may include optical components,projecting components, imaging devices, power sources, and/or lightsources. For example, display system 208 may include the components asdescribed in U.S. Pat. No. 7,595,933. In some embodiments, displaysystem 208 may include components that display images. For example,display system 208 may include a display element, such as a flat paneldisplay or a liquid crystal display, as described in U.S. Pat. No.7,595,933. In some embodiments, lens 104 may include a lens system thatrelays images to a user's eye from a display element.

User tracking system 206 may include one or more user location sensors120. User location sensor 120 may sense the location of the user. Userlocation sensor 120 may be mounted on and housed within eyeglasses 102.User location sensor 120 may be positioned in any suitable position. Thetype of user location sensor may include any suitable type of sensor.For example, user location sensor 120 may include a global positioningsystem receiver. The location, number, and type of user locationsensor(s) may be selected based on a number of factors. For example, thetype of user location sensor(s) may be selected based on the other typesof components included in system 100. In some embodiments, processor 202may be configured to communicate with user location sensor 120 todetermine the location of the user on a golf course and to determine thedistance between the user and a landmark on the golf course. Forexample, in some embodiments, processor 202 may be configured tocommunicate with user location sensor 120 to determine the distancebetween the user and the next pin on the course. Such information wouldhelp a user find his yardages during a round of golf.

Golf ball tracking system 200 may include one or more golf ball sensors.The golf ball sensor may be configured to detect the golf ball. The golfball sensor may be mounted on or housed within eyeglasses 102. Forexample, as shown in FIG. 1, a golf ball sensor 110 may be mounted suchthat golf ball sensor 110 is exposed through an opening 112 ineyeglasses 102. FIG. 1 shows golf ball sensor 110 as being mounted suchthat it will be positioned above the user's left eye when a user wearseyeglasses 102. In other embodiments, golf ball sensor 110 may bepositioned in any suitable position. The location and number of golfball sensors 110 may be selected based on a number of factors. Forexample, the location of the golf ball sensor 110 may be selected basedon the positioning of other components and/or the sensitivity of thegolf ball sensor 110.

In some embodiments, the golf ball sensor 110 may include a reflectivesensor capable of detecting the location of a golf ball without anycommunication components being provided within the golf ball. Forexample, the golf ball sensor 110 may include radar, LIDAR, optical,and/or sonar sensors. In some embodiments, the golf ball tracking system200 may include communication components provided inside and/or on thegolf ball. Such golf ball tracking systems may include a golf ballsensor 110 capable of detecting the location of a golf ball by detectinga tracking component provided within the golf ball. For example, thegolf ball tracking system 200 may include a radio-frequencyidentification system, a BLUETOOTH technology system, an infraredsystem, and/or global positioning system receiver.

In some embodiments, camera 204 may act as the golf ball tracking system200. Camera 204 may find the contrast difference between the golf balland the background of the ball as the golf ball travels. For example,camera 204 may find the contrast difference between the golf ball andthe sky as the golf ball flies through the air.

In some embodiments, the golf ball tracking system 200 may include aspecial coating on the golf ball. Such golf ball tracking systems 200may include a golf ball sensor 110 capable of detecting the location ofa golf ball by detecting the special coating provided on the golf ball.The special coating may include an ultraviolet sensitive paint and thegolf ball sensor 110 may include a camera 204 configured to captureimages illuminated by ultraviolet light only. For example, a UVtransmitting, visible light blocking filter may be included over thecamera lens so that only ultraviolet passes through the filter and allvisible light is absorbed by the filter.

In some embodiments, the golf ball sensor 110 and the user locationsensor 120 may include the same type of sensor. For example, the golfball sensor 110 and the user location sensor 120 may both include aninfrared system. Embodiments of golf ball tracking systems 200 aredescribed in more detail below.

Camera 204 may capture and record images from the user's viewpoint. Thecamera 204 may include any suitable type of camera. The type of cameramay be selected based on a variety of factors. For example, the type ofcamera may be selected based on the type of display included in thesystem or the type of golf ball tracking system 200 used in the system.The camera 204 may be mounted on or inside eyeglasses 102. For example,as shown in FIG. 1, a camera 204 may be mounted inside eyeglasses 102with a camera lens 106 exposed through an opening 108 in eyeglasses 102.FIG. 1 shows camera lens 106 as being mounted so that it will bepositioned above the user's right eye when a user wears eyeglasses 102.In other embodiments, the camera 204 may be positioned in any othersuitable position. The location of the camera 204 may be selected basedon a number of factors. For example, the location of the camera 204 maybe selected to provide the camera lens 106 in a position close to theuser's eye so that the view from the camera 204 is similar to the viewfrom the user's eye.

In some embodiments, processor 202 may be configured to processinformation relayed to and from the golf ball sensor 110 and/or thecommunication component provided with the golf ball. Processor 202 mayuse this information to determine the location of the golf ball. In someembodiments, the processor may also be configured to control displaysystem 208. As a result, the processor 202 may control the images shownby the display. In some embodiments, processor 202 may be configured toprocess information relayed to and from user location sensor 120. Theprocessor 202 may use this information to determine the location of theuser. In some embodiments, the processor 202 may determine the distancebetween the user and a landmark, such as the pin or a restroom. In someembodiments, processor 202 may be configured to process informationrelayed to processor 202 from camera 204. Processor 202 may use thisinformation to display images captured and recorded by the camera to theuser. Processor 202 may be configured to display enhanced images to theuser.

In some embodiments, the system may include an interface 114 configuredto communicate with components of the system. In some embodiments, theinterface may be in communication with golf ball tracking system 200,camera 204, and/or eyeglasses 102 either directly or through processor202. Interface 114 may be in communication with processor 202, golf balltracking system 200, camera 204, and/or eyeglasses 102 either wirelesslyor by wire. For example, FIG. 1 shows wire 116 extending through anopening 122 in eyeglasses 102. Wire 116 may couple interface 114 toprocessor 202. Interface 114 may provide the user with a way to controlsystem 100. In some embodiments, interface 114 may have an interfacedisplay. Such an interface display may show information about controlsettings and commands for system 100. In some embodiments, interface 114may have inputs for providing data and control signals to system 100.For example, interface 114 may have buttons. In some embodiments, system100 may include a touch screen that provides both an interface displayand an input. In some embodiments, a user may wear eyeglasses 102 andput interface 114 in his pocket during use.

As discussed above, golf ball tracking system 200 may include a golfball provided with communication components that are configured tocommunicate with a golf ball sensor 110. FIGS. 3 and 4 show a golf ball300 that may be provided with communication components. Golf ball 300may include any suitable type of golf ball. For example, in someembodiments, golf ball 300 may be a one-piece golf ball. In otherembodiments, golf ball 300 may be a multi-piece golf ball, such as a2-piece or 3-piece golf ball. Golf ball 300 may have an outer surfaceincluding dimples 302. Golf ball 300 may be provided with communicationcomponents including emitting diodes 304 and a microchip 400. Forexample, the communication components may include those described inU.S. Pat. No. 6,634,959, entitled Golf Ball Locator, issued to Kuesterson Oct. 21, 2003, the disclosure of which is hereby incorporated byreference in its entirety, and as described in U.S. Pat. No. 5,564,698,entitled Electromagnetic Transmitting Hockey Puck, issued to Honey etal. on Oct. 15, 1996, the disclosure of which is hereby incorporated byreference in its entirety. Emitting diodes 304 may be disposed on theouter surface of golf ball 300. FIG. 4 shows a cross-sectional view ofgolf ball 300. As shown in FIG. 4, microchip 400 may be disposed insidegolf ball 300. Emitting diodes 304 may be connected to microchip 400 bywires 402. In some embodiments, microchip 400 may be configured to powerand control emitting diodes 304. In some embodiments, microchip 400 maybe configured to communicate with processor 202. For example, microchip400 may be configured to communicate with processor 202 via wirelesssignals. In some embodiments, microchip 400 may include a power source,timing circuits, on/off switches, a pulsing circuit, and/or shocksensors to control the powering of emitting diodes 304. In suchembodiments, the shock sensors may be configured to detect movement ofgolf ball 300. Accordingly, movement of golf ball 300 may trigger theon/off switch to power emitting diodes 304. To conserve power, timingcircuits may be configured to control how long emitting diodes 304 arepowered. Thus, shock sensors may detect when a golf club strikes golfball 300, which may trigger the on/off switch to power emitting diodes304 while golf ball 300 is in flight. After a predetermined amount oftime, the timing circuits may trigger the on/off switch to shut offpower to emitting diodes 304.

In embodiments in which golf ball 300 includes emitting diodes 304, golfball sensor 110 may be configured to detect signals from emitting diodes304. For example, emitting diodes 304 may include infrared emittingdiodes and golf ball sensor 110 may include an infrared receiver. Golfball sensor 110 may transmit this data to processor 202. Processor 202may be configured to use this data to determine the location of emittingdiodes 304, and thus, the location of golf ball 300. In someembodiments, in place of or in addition to golf ball sensor 110, camera204 may be configured to detect emissions from emitting diodes 304. Insome embodiments, in place of or in addition to golf ball sensor 110,multiple golf ball sensors may be provided in the location in which thegolf ball is to be tracked. For example, multiple golf ball sensors maybe provided in various positions on a golf course. In such embodiments,the position of the golf ball sensors may be known and the golf ballsensors may be used to determine the location of the golf ball bydetecting emissions from emitting diodes 304.

FIG. 5 illustrates a user 500 wearing eyeglasses 102 while using a golfclub 508 to hit a golf ball 300 off of a tee 504 in a tee box 506 alongpath 510. FIG. 6 shows the user's view after he hits golf ball 300.Eyeglasses 102 provide an enhanced image of golf ball 300 imposed uponthe user's real world view such that the enhanced image's positionmatches the position of golf ball 300. In FIG. 6, the user's real worldview through lens 104 includes golf ball 300, a tree 514, and a pond 512disposed within user's line of sight. The enhanced image adds a comettail 600 to golf ball 300 as golf ball 300 flies through the air towardtree 514 and pond 512. Comet tail 600 may lag behind golf ball 300 suchthat comet tail 600 stays visible after golf ball 300 lands. Comet tail600 may represent at least a portion of the trajectory of golf ball 300.In some embodiments, comet tail 600 may represent the entire trajectoryof golf ball 300. As a result, user 500 may see the entire trajectory ofgolf ball 300 at least temporarily after golf ball 300 lands.

FIG. 8 shows a method 800 of displaying an enhanced image of the golfball imposed upon the golfer's real world view according to anembodiment. The steps of method 800 may be performed in any order. Step802 may include capturing and recording images from the user'sviewpoint. Step 804 may include transmitting the recorded images toprocessor 202. Camera 204 may perform steps 802 and 804. Step 806 mayinclude tracking the location of golf ball 300. Golf ball trackingsystem 200 and/or processor 202 may perform step 806. For example, inthe embodiment discussed above with reference to FIGS. 3 and 4, hittinggolf ball 300 may trigger shock sensors. As a result, on/off switchesmay cause microchip 400 to power emitting diodes 304, which may causeemitting diodes 304 to pulse. Golf ball sensor 110 may detect the pulsesand transmit data to processor 202. Processor 202 may use thetransmitted data to determine the location of emitting diodes 304, andthus, the location of golf ball 300.

Step 808 may include displaying an enhanced image of golf ball 300 uponthe user's real world view. In some embodiments, processor 202 may usethe location of golf ball 300 and the images recorded by camera 204 tomake display system 208 display an enhanced image of golf ball 300 touser 500. The enhanced image may be displayed such that the enhancedimage overlays the user's real world view. In some embodiments, theenhanced image may be transparent. In some embodiments, the enhancedimage may be stereoscopic. In some embodiments, the enhanced image maybe bigger and/or brighter than the recorded image. For example, theenhanced image may appear to be glowing. The enhanced image may beselected to make golf ball 300 and the trajectory of golf ball 300 standout more to the user while allowing user to still see a real world view.As shown in FIG. 6, the enhanced image may include comet tail 600trailing behind golf ball 300. Comet tail 600 may show the trajectory ofgolf ball 300 such that user 500 can compare the trajectory of golf ball300 to an ideal trajectory. In some embodiments, display system 208 maydisplay an ideal trajectory such that the trajectory of golf ball 300may be compared with the ideal trajectory.

In some embodiments, processor 202 may use the location of golf ball 300at various times to determine launch information and/or flightinformation about golf ball 300. In some embodiments, to determinelaunch information and/or flight information about golf ball 300, system100 may use methods and components described in U.S. Patent ApplicationPublication 2007/0021226, entitled Method of and Apparatus for TrackingObjects in Flight Such as Golf Balls and the Like, applied for byTyroler and published on Jan. 25, 2007, the disclosure of which ishereby incorporated by reference in its entirety. In some embodiments,to determine launch information and/or flight information about golfball 300, system 100 may use methods and components described in U.S.Patent Application Publication 2005/0233815, entitled Method ofDetermining a Flight Trajectory and Extracting Flight Data for aTrackable Golf Ball, applied for by McCreary et al. and published onOct. 20, 2005, the disclosure of which is hereby incorporated byreference in its entirety. In some embodiments, to determine launchinformation and/or flight information about golf ball 300, system 100may use methods and components described in U.S. Patent ApplicationPublication 2010/0151955, entitled Global Positioning System Use forGolf Ball Tracking, applied for by Holden and published on Jun. 17,2010, the disclosure of which is hereby incorporated by reference in itsentirety. To determine launch information and/or flight informationabout golf ball 300, system 100 may use methods and components describedin U.S. Patent Application Publication 2008/0254916, entitled Method ofProviding Golf Contents in Mobile Terminal, applied for by Kim et al.and published on Oct. 16, 2008, the disclosure of which is herebyincorporated by reference in its entirety. FIG. 7 shows how informationmay be displayed to the user. For example, launch information, such asinitial velocity, and the distance to the pin may be displayed on lens104. In another example, lens 104 may display the ball spin rate and/orlaunch angle. By displaying information to user 500 on eyeglasses 102,user 500 may reference this information without having to pull out adevice or without having do anything other than look in front of hiseye. Accordingly, the user may quickly and easily reference informationwithout having to distract from other activities.

In some embodiments, system 100 may include a separate launch monitorconfigured to monitor and record data related to the golf ball, golfclub, and/or golfer. For example, system 100 may include the launchmonitor described in U.S. patent application Ser. No. 13/307,789,entitled Method and Apparatus for Determining an Angle of Attack fromMultiple Ball Hitting, applied for by Ishii et al. and filed on Nov. 30,2011, the disclosure of which is hereby incorporated by reference in itsentirety. The separate launch monitor may be in communication withprocessor 202.

User tracking system 206 may determine the location of user 500. Forexample, in embodiments in which global positioning system receiver 120is included in eyeglasses 102, global positioning system receiver 120may determine the location of user and transmit the location of the userto processor 202. Processor 202 may be configured to know the locationsof various landmarks on a golf course. Processor 202 may be configuredto determine the distance between the location of the user and thevarious landmarks on the golf course. For example, processor 202 may beconfigured to determine the distance between user 500 and the next pinon the golf course. Processor 202 may be configured to display thisdistance to user 500, as shown in FIG. 7. In some embodiments, the usermay be a golfer wearing eyeglasses 102. In some embodiments, the usermay be a caddy wearing eyeglasses 102 and watching a golfer. The caddymay use the system to help the golfer choose clubs, adjust his swing,and find golf balls. In some embodiments, the user may be a spectatorwearing the eyeglasses and watching a golfer.

In some embodiments, system 100 may display an image of golf ball 300and/or an image of user 500 on a representation of the golf course.Display system 208 may display these images to user 500 on eyeglasses102 to help user 500 navigate and/or locate golf ball 300. To displaythe images, system 100 may use the methods and components described inU.S. Patent Application Publication 2007/0021226, U.S. PatentApplication Publication 2005/0233815, U.S. Patent ApplicationPublication 2010/0151955, and/or U.S. Patent Application Publication2008/0254916.

FIG. 9A schematically illustrates a (non-enhanced) view 900 that a usermay have while standing in a fairway 902 of a golf course. In thisexample, the user may see the fairway 902, the rough 904, a lake 906, aprominent tree 908, the green 910, and a sand bunker 912 next to thegreen 910. FIG. 9B schematically illustrates an enhanced view 920 of thescene provided in FIG. 9A, which may be available, for example, throughthe eyeglasses 102 described above.

Using the user's present location as determined by the user trackingsystem 206, together with known locations of the various objects, theprocessor 202 may compute a plurality of relative distances and displaythem to the user via the eyeglasses 102. In addition to computingrelative distances, such as by differencing GPS location coordinates,the system 100 may utilize miniaturized optical, radar, or LIDAR sensorsprovided on the eyeglasses 102 (e.g., sensors that may be used with thegolf ball tracking system 200) to determine the distance between theuser and the one or more respective objects. This reading may theneither be used instead of the GPS measurement, or may be fused withand/or used to refine the GPS measurement.

Once the distances to the various objects are computed, numericalrepresentations 922 of the distances may be displayed within the user'sview either coincident with the object or directly adjacent to theobject. In this example, distances are computed and displayed for thenearest shoreline of the lake 906, the farthest shoreline of the lake906, the prominent tree 908, the front, middle, and back of the green910, and the center of the sand bunker 912. In one configuration, themarked objects (i.e., those objects to which distances are provided) maybe pre-determined by the user, a different user, or a golf professionalfamiliar with the course. Once the ball is struck, these distances mayclear from the view, and other views (such as a ball trace) may bedisplayed.

In addition to merely computing and displaying distances to objects, thesystem 100 may be configured to display visual imagery in a manner thatmakes the imagery appear to the user as if it is resting on or slightlyabove the ground. For example, in FIG. 9B, the system 100 may projectdistance lines 924, 926, 928 across the fairway to indicate 100 yds, 150yds, and 200 yds (respectively). It should be appreciated that theseyardages are arbitrary, and may be customized by the user. In oneconfiguration, such as schematically illustrated in FIG. 9C, thedistance lines may coincide with average or typical hitting distancesthat are typical for the user following a full-powered swing. Forexample, the system 100 may project lines 930, 932, 934 that arerepresentative of a full power swing from a 4 iron, a 5 iron, and an 8iron (respectively). In one configuration, the club-based distance lines930, 932, 934 that are displayed may dynamically adjust based on thedetermined yardages to the various objects and/or safe landing zones. Inthis manner, the system 100 may aid the user in determining the properclub to use for a given shot.

In one configuration, the club-based distance lines 930, 932, 934 may bebased on hitting data that the user may manually enter into the system100 according to known tendencies. In another configuration, thedistance lines 930, 932, 934 may be based on actual shot data that isrecorded by the system 100 and averaged for each club. This statisticalaveraging may, for example, use filtering techniques to prevent errantshots or outlier distances from affecting the mean-max club distances.To facilitate the automatic data-gathering, the system 100 mustunderstand which club was used for each resulting shot. This may occurthrough, for example, user input, visual recognition of the club whenthe club is drawn from the bag (e.g., through visual recognition of thenumber on the sole of the club, or through other visual recognitionmeans, such as 2D or 3D barcodes, QR Codes, Aztec Codes, Data Matrixcodes, etc), RFID, or Near-Field Communications.

Referring to FIG. 10, in one configuration, the enhanced image mayfurther include a putting aid 950 that may assist the user in readingthe curvature and/or undulations of the green. Such a putting aid 950may include a slope grid 952 and/or an ideal trajectory line 954, which,if followed, would cause the ball to roll into the cup 956. In oneconfiguration, the slope grid 952 may include a plurality of virtualwater beads 958 that may flow along the grid lines according to theabsolute slope of the green 960 along the line (i.e., where a steepergradient would result in a faster moving water bead 958 along the gridline). In another configuration, the putting aid 950 may include, forexample at least one of a plurality of arrows aligned with a gradient ofthe green (and pointing in a down-hill direction) and an indicator, suchas a ball or cursor, that translates in a direction aligned with thegradient of the green. In this manner, the golfer may easily visualizewhether he/she is putting uphill or downhill, and whether the ball maybreak to the right or to the left. The ideal trajectory 954 may takeinto account the slope of the green 960, and the respective locations ofthe ball and cup 956.

In the enhanced image examples provided in FIGS. 9B, 9C, and 10, theability to project an image on the ground requires an understanding ofthe topology of the ground relative to the eyeglasses 102. In oneconfiguration, the topology of the golf course may be uploaded to thesystem 100, either prior to the start of the round, or in near-realtime. The processor 202 may then pattern match the perceived topologywithin the more detailed, uploaded topology to align the two coordinateframes. This alignment may use GPS, visual recognition, and/or LIDAR, toidentify perspective cues and/or one or more fiducials to position andorient the glasses in three dimensions within the topographical model.Using the known position and orientation of the eyeglasses 102, theprocessor 202 may construct a perspective view of the topology from thepoint of view of the user. This perspective view of the topology maythen be synchronized with the field of view of the user (such as may bedigitally perceived via the camera 204) and the processor 202 maydisplay the visual overlays/enhanced imagery via the eyeglasses 102 in amanner that makes it appear to rest on the ground or objects as desired.For example, in a green reading context, the one or more putting aids950 may be displayed such that they are coincident with the perceivedportion of the green 960.

In another configuration, rather than having the topographicalinformation uploaded from an external database, it may instead beacquired in near-real time via one or more sensors disposed on theeyeglasses 102. For example, in one embodiment, the eyeglasses 102 mayinclude a LIDAR sensor (e.g., which may be used with the golf balltracking system 200). The LIDAR sensor may scan the proximate terrainwith a sweeping laser (i.e., ultraviolet, visable, or near-infrared) todetermine the distance between the sensor and each sampled point. Theprocessor 202 may then skin the collection of points to form a model ofthe perceived topology.

When used to assist the user in reading the green 960, the system 100may dynamically adjust to display the nearest green. In oneconfiguration, the processor 202 may, for example, continuously receivean indication of the location of the user, such as from the usertracking system 206. Using this, the processor 202 may identify one ofthe plurality of stored greens that is closest to the user. Theprocessor 202 may then display a representation of the topology of theidentified green 960 via the heads up display glasses, within the fieldof view of the user (i.e., either an overhead view or a perspectiveview). During a round of golf, this may allow a user to see the contoursof the green as he is readying for an approach shot, as well as whileputting.

While FIGS. 9B, 9C, and 10 schematically illustrate enhanced imagesbefore a shot, and FIG. 6 schematically illustrates an enhanced imageduring a shot, FIGS. 7 and 11 schematically illustrate enhanced imagesafter a shot. As shown in FIG. 11, following a shot, the system 100 maytextually display statistics that relate to both the previous shot 1000(i.e., shot statistics 1000) and to more general play statistics 1002.The play statistics 1002 may be statistics that are aggregated eitherjust for that particular round, or over a longer duration such as aseason. In addition to displaying statistics following the shot, thesystem 100 may also maintain a ball flight trace 1004 within theenhanced image for a predetermined amount of time.

Statistics relating to the previous shot 1000 may include, for example,initial ball speed 1006, spin rate 1008, carry 1010, and/or remainingdistance to the pin 1012. Play statistics 1002 may include, for example,total number of strokes for the round 1014, score relative to par 1016,fairways hit 1018, greens in regulation 1020, and/or average number ofputs 1022.

The shot statistics 1000 may be directly acquired through the one ormore sensors disposed on the eyeglasses 102, within the ball, or on anassociated device (e.g., a launch monitor), or may be determined by theprocessor 202 through, for example, an analysis of the ballflight/trajectory. The play statistics 1002, however, may each bemaintained in memory associated with the system 100 and updatedfollowing each shot. While certain play statistics 1002 (e.g., totalstrokes 1014 and average number of putts 1022) may be easily aggregatedsimply by observing the user, others require the processor 202 to havean understanding of the course. For example, a user's score relative topar 1016 requires the system 100 to have knowledge of the coursescorecard. Likewise, fairways hit 1018 and greens in regulation 1020 mayrequire the system 100 to have knowledge of the physical layout of thecourse. To facilitate this knowledge, in one configuration, a digitalrendering of the course (i.e., layout and/or topology) and/or scorecardmaybe uploaded to the system 100 prior to beginning the round. Thislayout and/or topology may be the same data that is uploaded, forexample, to enable the system 100 to project imagery onto the groundwithin the user's real world view.

In addition to the above described game-play capabilities, the system100 may further be configured in a practice mode, such as schematicallyillustrated via the enhanced display 1050 provided in FIG. 12. Practicemode may be particularly useful, for example, on a driving range, wherethe user may hit a plurality of golf balls in succession using a singlegolf club. In this embodiment, the system 100 may maintain shotstatistics 1000 on each of the plurality of golf balls that are hit byone or more golf clubs. The shot statistics 1000 may be grouped andaveraged on a club-by-club basis, which may then be displayed via theeyeglasses 102 as specific club statistics 1052 for a particular club.These statistics may be displayed for an individual club, such as whenthe user draws the club from his/her bag or immediately after a shot.Alternatively, the club statistics 1052 may be displayed for a pluralityof clubs, such as in a table format. Displaying multiple clubs at oncemay educate the user about the variance and/or differences between clubsof slightly different lofts. For example, if a user was presently usinga 5-iron, the system may display club statistics for the 5-iron, as wellas for the 4-iron and 6-iron.

The club statistics 1052 for a particular club may include, for example,an average carry distance 1054, an average total distance 1056, and anaccuracy metric 1058. The accuracy metric 1058 may attempt tocharacterize the amount of spray (i.e., a lateral deviation from anintended landing spot) that the user imparts to each of his/herrespective clubs. For example, the accuracy metric 1058 may correspondto a width of a landing zone that is defined by the landing position ofeach of the plurality of golf balls hit by a particular club.Alternatively, it may represent a one standard deviation width of adistribution of landing positions for each of the plurality of golfballs.

In one configuration, the shot statistics 1000 and/or club statistics1052 within practice mode may be determined either directly by sensorsprovided with the system 100 (e.g., sensors disposed on the eyeglasses102), or via ancillary hardware (e.g. a launch monitor) that is indigital communication with the system 100.

In addition to maintaining the club statistics 1052 while in practicemode, the system 100 may also graphically represent a plurality of priorshots as traces 1062 via the enhanced display 1050. The system 100 mayalso be configured to display an inlaid image 1064 within the user'sfield of view that represents the plurality of traces 1062 from adirection that is perpendicular to each ball's respective flight path.In this manner, the user may visually assess his/her tendencies to spraythe ball (e.g., via the traces 1062 provided in the primary portion 1066of the enhanced display 1050), as well as the typical flight path/heightof each respective shot (e.g., via the traces 1062 provided in theinlaid image 1064). As mentioned above, in one configuration, the system100 may know which club the user is hitting either by direct user input,or by visually recognizing the number on the sole of the club as theuser selects it from his/her bag. In this manner, the processor maygroup the one or more computed shot statistics according to a detectedidentifier on the club, and then compute the one or more club statistics1052 for a particular golf club from the one or more shot statistics1000 that are grouped/associated to a single detected identifier.

If a user trains the system 100 to understand the user's various clubstatistics 1052, then the system 100 may also be configured in anenhanced virtual caddy mode. In this mode, the system 100 may instructthe user both where to aim and which club to use. For example, asschematically shown in the enhanced view 1100 provided in FIG. 13, inone configuration, the system 100 may provide a textual graphic 1102 ofthe optimal club for a given shot. Additionally, the system 100 mayproject a target 1104 at a position on the course (i.e., via theeyeglasses 102) where the user should aim with that respective club. Thetarget 1104 may be, for example, a dot or cross-hair that is illustratedat the desired landing spot, or may be an illustrated post or flag stickthat graphically appears to be sticking out of the ground at the desiredlanding spot. The target 1104 may be positioned at the user'sstatistical mean landing spot for the club suggested. Additionally, thesystem 100 may project, for example, a 1-standard deviation accuracycircle 1106 onto the grass around the target 1102. In this manner, theuser may quickly identify whether certain hazards may be in play forthat shot.

In the virtual caddy mode, the user may either pre-select his/herintended degree of risk prior to the round and/or may be able to changethe desired risk level on a shot-by-shot basis. The risk level may bedisplayed via the eyeglasses 102 as a textual risk indicator 1108 priorto the shot. The level of risk may serve as an input into anoptimization routine performed by the processor 202, and may influenceboth the club that the system 100 selects and the positioning of thetarget 1104 on the course. More specifically, the level of risk mayadjust a weighting parameter in an optimization routine that seeks tominimize both the remaining distance to the hole and the statisticallikelihood that a hazard will be in play (i.e., longer hittingwoods/irons typically have a larger spray, which may increase thelikelihood of bringing hazards into play (based on the design of thehole); shorter hitting wedges/irons have a narrower spray and can bemore accurately aimed, though lack the hitting distance of the longerirons/woods).

In one configuration, an optimization method may begin by determiningthe most optimal target for each club, based on the course layout, theuser's current position, and the stored club statistics 1052. Eachoptimal target for a club may be disposed at a location on the coursethat is spaced from the location of the user by a distance that is equalto the average total distance for the respective club used (i.e., whereaverage total distance is a club statistic that is previously stored inmemory associated with the processor). To choose the specific headingfor each optimal target, the processor may then find a location thatprovides the most ideal combination of lie and remaining distance to thepin.

More specifically, in determining the optimal target, the system 100 mayscore each type of lie within a statistical circle around the target,corresponding to a probable/statistical landing zone and/or derived fromthe accuracy metric for the respective club. For example, out of boundsand water hazards may have a score of 0.0; flat, unobstructed fairwaymay have a score of 1.0; and obstructed shots, sand, long rough, mediumrough, short rough, and uneven lies may have differing scores that rangebetween 0.0 and 1.0. The processor may then integrate the lie score (ormay average the lie score) across the statistical circle to determine anaggregate lie score. Using this scoring, the processor 202 may determinethe most optimal target for each club that provides the most ideal lie(i.e., in the scoring described above, the ideal lie would maximize theaggregate lie score), while also minimizing the remaining distance tothe hole. Such a determination may occur using a first risk-weightedoptimization that operates according to a first weighting parameter thatmay generally favor an improved lie over a minimized distance (i.e.,where distance may factor in, for example, in deciding between twotargets with identical lies, and in preferring shots toward the holerather than away from the hole).

Once the most optimal target is selected for each club, the processor202 may determine a new risk-weighted score for each club that combinesa remaining distance to the hole for an optimized target with theaggregate lie score for the optimized target. This determination may bebased on second weighting factor that is selected by the user toindicate the user's predetermined risk level. In this manner, a highrisk would more heavily favor a minimum remaining distance, while a lowrisk would more heavily favor a more ideal lie. Once a risk-weightedscore is determined for each club, the club having the highestrisk-weighted score may be suggested to the user as a textual graphic1102, and the optimal target 1104 may be displayed in a proper positionwithin the enhanced view. Additionally, in an embodiment, thestatistical landing zone may be displayed as a circle around the target.In other configurations, the user may further be able to specify (or thesystem 100 may deduce) preferred approach distances, which may alsoaffect the optimization.

Finally, FIG. 14 schematically illustrates a method 1200 that may beperformed by the processor 202. This method 1200 includes functionalitythat may exist in practice mode 1300, and also during a round before ashot 1400, during a shot 1500, and after a shot 1600. As shown, duringpractice mode 1300, the processor 202 may begin by determining a clubthat is being used at 1302. This may entail either receiving a userinput that is indicative of the club, or by receiving a visualindication of a number provided on a sole of the club from a visualsensor associated with the eyeglasses 102.

Once the club is determined at 1302, the processor 202 may monitor thetrajectory of a struck golf ball at 1304, determine one or more shotstatistics 1000 at 1306, display the one or more determined shotstatistics 1000 via the eyeglasses 102 at 1308, and update the one ormore club statistics 1052 at 1310. In one configuration, steps 1304 and1306 may be performed using input from one or more sensors disposed, forexample, on the eyeglasses 102. In another configuration, steps 1304 and1306 may be performed using input obtained from an ancillary device,such as a launch monitor, that is in digital communication with theprocessor 202. In this instance, the term processor 202 is intended toencompass both configurations, and may include multiple computingdevices in digital communication.

Following a given shot, the processor 202 may determine if a new club isselected at 1312. If so, it may revert back to step 1302, or else maywait for the next shot at 1304. The club statistics may then be storedin memory 1700 associated with the system 100 for subsequent use.

Prior to a round of golf, the system 100 may be initialized at 1702 byuploading course statistics, course layout and/or topology, and/or acourse scorecard (i.e., collectively “course information”) from anexternal database 1704 to the processor 202. Additionally, during thisinitialization step 1702, the user's club statistics 1052 may be madeavailable to the processor 202 from memory 1700. While in oneconfiguration, the club statistics 1052 may be derived from a practicemode using the present system, in another configuration the clubstatistics 1052 may be uploaded to the memory 1700 via any commerciallyavailable 3rd party devices 1706, such as golf simulation devices orlaunch monitors.

Prior to a shot, the processor 202 may monitor a user's real-timelocation at 1402. This may include monitoring one or more GPS receivers,RF triangulation modules, and optical sensors to determine the locationof the user within the course. If the user is not stationary (at 1404),then the processor 202 may continue monitoring the user's position. Ifthe user's location has become stationary, then at 1406, the processor202 may determine the distance between the user and any object, hazard,landmark, or course feature (e.g., fairway, rough, green) that may bewithin a predetermined distance of the user and/or between the user andthe furthest portion of the green from the user. This determination mayoccur using GPS coordinates and/or one or more optical sensors, such asLIDAR.

Following the distance determination at 1406, the processor may performone or more of the following: display one or more of the determineddistances to the user via the eyeglasses 102 (at 1408); display one ormore yardage-based distance lines 924, 926, 928 to the user via theeyeglasses 102 (at 1410); display one or more club-based distance lines930, 932, 934 to the user via the eyeglasses 102 (at 1412); perform arisk-weighted optimization to determine at least one of an optimal cluband an optimal target (at 1414); display an optimal club to the user viathe eyeglasses 102 (at 1416); display an optimal target to the user viathe eyeglasses 102 (at 1418); display the user's statistical landingzone about the target via the eyeglasses 102 (at 1420); and display aputting aid to the user via the eyeglasses 102 (at 1422), where theputting aid includes either a displayed grid (at 1424) or an idealputting trajectory (at 1426).

During the shot 1500, the processor 202 may receive a data inputcorresponding to the ball dynamics (at 1502) and/or the user's view (at1504). From this input, the processor 202 may then determine one or moreshot statistics 1000 (at 1506). The determined shot statistics 1000 mayinclude, for example, ball speed, 1006, spin rate 1008, carry 1010, andremaining distance to the pin 1012, and may be determined from theobserved ball trajectory, the observed club impact angle/speed, or froman associated launch monitor or ancillary device/sensor. Additionally,during the ball flight, the processor 202 may display a visualindicator, trace, or other overlay via the eyeglasses 102 thatcorresponds with the actual, observed flight of the ball (at 1508).

After the shot 1600, the processor 202 may display the one or moredetermined shot statistics 1000 via the eyeglasses 102 (at 1602).Additionally, the processor 202 may then compute one or more playstatistics 1002 (at 1604), and may display the one or more computed playstatistics 1002 to the user via the eyeglasses 102 (at 1606). Theprocessor 202 may then recompute the club statistics 1052 (at 1608) andresume monitoring the user's real-time location at 1402 to prepare forthe next shot.

While the use of the eyeglasses 102 is the preferred manner ofpracticing the present invention, in alternate configurations, one ormore of the steps of displaying the various pre-shot distances and/orpost-shot shot statistics 1000 or play statistics 1002 may occur usingthe interface 114 (shown in FIG. 1), which may include a hand helddevice, such as a smart phone or tablet. Additionally, in a furtherembodiment, pre-shot distances and/or post-shot shot statistics 1000 orplay statistics 1002 may be superimposed on a video stream that iscaptured by a camera on the hand held device, and displayed by anLCD/OLED/LED display device integrated within the hand held device. Inthis embodiment, the glasses may not be strictly required.

While various embodiments of the invention have been described, thedescription is intended to be exemplary, rather than limiting and itwill be apparent to those of ordinary skill in the art that many moreembodiments and implementations are possible that are within the scopeof the invention. Accordingly, the invention is not to be restrictedexcept in light of the attached claims and their equivalents. Also,various modifications and changes may be made within the scope of theattached claims.

1. A golf aid for displaying one or more golf-related statistics to auser, the golf aid comprising: a golf ball tracking system for trackinga flight of a golf ball; a heads up display configured to be worn on theuser's head and display an image within a field of view of the user; aprocessor in communication with the golf ball tracking system and theheads up display, the processor configured to: compute one or more shotstatistics from the tracked flight of the golf ball; wherein the one ormore shot statistics include at least one of an initial ball speed, aspin rate, a carry, and a remaining distance to the pin; and display theone or more computed shot statistics within the field of view of theuser via the heads up display.
 2. The golf aid of claim 1, wherein thegolf ball tracking system includes one or more sensors disposed on theheads up display.
 3. The golf aid of claim 2, wherein the one or moresensors include at least one of a camera, a radar, or a lidar sensor. 4.The golf aid of claim 1, wherein the golf ball tracking system includesa launch monitor.
 5. The golf aid of claim 1, wherein the processor isfurther configured to: maintain one or more play statistics relating toa plurality of golf shots; wherein the one or more play statisticsinclude at least one of a total number of strokes for a round, a scorerelative to par, a number of fairways hit, a number of greens inregulation, and an average number of puts per green; and display the oneor more play statistics within the field of view of the user via theheads up display.
 6. The golf aid of claim 1, wherein the processordisplays the shot statistics for only a predetermined amount of timefollowing a shot.
 7. The golf aid of claim 1, wherein the processor isfurther configured to use the tracked flight of the golf ball to displayan enhanced image of the golf ball flight within the field of view ofthe user via the heads up display.
 8. A golf aid for displaying one ormore golf-related statistics to a user, the golf aid comprising: a golfball tracking system for tracking a flight of a golf ball; a heads updisplay configured to be worn on the user's head and display an imagewithin a field of view of the user; a processor in communication withthe golf ball tracking system and the heads up display, the processorconfigured to: compute one or more shot statistics from the trackedflight of the golf ball; maintain one or more play statistics relatingto a plurality of golf shots; display the one or more computed shotstatistics, the one or more play statistics, and an enhanced image ofthe golf ball flight within the field of view of the user via the headsup display.
 9. The golf aid of claim 8, wherein the one or more shotstatistics include at least one of an initial ball speed, a spin rate, acarry, and a remaining distance to the pin; and wherein the one or moreplay statistics include at least one of a total number of strokes for around, a score relative to par, a number of fairways hit, a number ofgreens in regulation, and an average number of puts per green.
 10. Thegolf aid of claim 8, wherein the golf ball tracking system includes oneor more sensors disposed on the heads up display.
 11. The golf aid ofclaim 10, wherein the one or more sensors include at least one of acamera, a radar, or a lidar sensor.
 12. The golf aid of claim 8, whereinthe golf ball tracking system includes a launch monitor.
 13. The golfaid of claim 8, wherein the processor displays the shot statistics foronly a predetermined amount of time following a shot.
 14. Anon-transitory, computer readable medium having stored thereoninstructions for execution by a processor to perform steps comprising:receiving an indication of a tracked flight of a golf ball from asensor; computing one or more shot statistics from the tracked flight ofthe golf ball; wherein the one or more shot statistics include at leastone of an initial ball speed, a spin rate, a carry, and a remainingdistance to the pin; and displaying the one or more computed shotstatistics within the field of view of the user via a heads up displayconfigured to be worn on the user's head.
 15. The computer readablemedium of claim 14, further comprising instructions for causing theprocessor to perform the steps of: maintaining one or more playstatistics relating to a plurality of golf shots; wherein the one ormore play statistics include at least one of a total number of strokesfor a round, a score relative to par, a number of fairways hit, a numberof greens in regulation, and an average number of putts per green; anddisplaying the one or more play statistics within the field of view ofthe user via the heads up display.
 16. The computer readable medium ofclaim 14, further comprising instructions for causing the processor touse the tracked flight of the golf ball to display an enhanced image ofthe golf ball flight within the field of view of the user via the headsup display.